This Page is Inserted by IFW ladexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images ,^thii. this document are accmte tepresentadoii. «f orieii«a 

documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ black BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SffiES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES- ^ 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBrr(S) SUBMTTTED ARE POOR Q0AUTY 



IMAGES 4RE BEST AVAILABLE COPYo 
As rescasiiniifflg these doOTinents will not correct tli® imn 
problems checked, please do Eot report tliese problems 
the IFW Imsige Problem MaalboXo 



This Page Blank (uspto) 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
Inteinadonal Bureau 




PCX 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Clasafication ^ : 
GIOL 



A2 



(11) International Publication Number: WO 94/25958 

(43) International PuUication Date: 10 November 1994 (10.11.94) 



(21) International Application Number: PCT/DK94/00164 

(22) International Filing Date: 22 Apiil 1994 (22.04.94) 



(30) Priority Data: 

0464/93 



22 April 1993 (22.04.93) 



DK 



(71)(72) Applicant and Inventor: LEONHARD, Frank, Uldall 
[DK/DK]; Louisevej 13, DK-2800 Lyngby (DK). 

(74) Agent: PLOUGMANN & VINGTOFT A/S; Sankt Annx Plads 
11, P.O. Box 3007, DK-1021 Copenhagen K (DK). 



(81) Dejagnated States: AT, AU, BB. BG, BR, BY, CA, CH, C:N. 
CZ, CZ (UtiHty model), DE, Dfi (UtiUty model), DK, DK 
(Utility model), ES, FI, H (Utility model), GB, GE, HU, 
JP, KG, KP, KR, KZ, LK, LU, LV, MD, MG, MN. MW, 
NL, NO, NZ, PL, PT, RO, RU, SD, SE, SI, SK, SK (Utility 
model), TJ, IT, UA, US, UZ, VN, European patent (AT, 
BE, CH, DE, DK, ES, FR, GB, OR, IE, IT, LU, MC, ^^L, 
PT, SE), OAPI patent (BF. BJ, CF, CXj, CI, CM, GA, GN. 
ML, MR, NE, SN, TD, TG). 



Published 

Without international search report and to be republished 
upon receipt of that report. 



(54) Title: METHOD AND SYSTEM FOR DETliCTlNG AND GENERATING TRANSIENT CONDITIONS IN AUDITORY SIGNALS 



(57) Abstract 



The shape of energy changes of an auditory signal is used for identifyiag or lepresenting features which can be perceived by a human 
ear as representing a distinct sound picture. In order to extract information from the shape of the energy changes, the shape is preferably 
being tepiesented by the shape of a transient pulse of the signal. It is preferred that an envelope detection is being used in order to obtain 
the transient signal pulse. The energy change repiesenting the distinct sound picture can be a phoneme or vowel. The invention also relates 
to a method for identi^ng the energy changes in the auditory signal by comparing the shape of energy changes of the signal, which can be 
represented as the shape of the transient pulse, with predetermined energy change shapes representing distinct sound pictures. The invention 
also relates to a method of speech synthesis wherein a series of transient pulses is generated correspouding to the series of phonemes to be 
synthesized. The invention fiirtber relates to a systetn for processing an auditory signal in order to reduce the bandwidth of the signal with 
substantial retention of the information of the signal, the system comprising means for extracting the dansient component of the auditory 
signal, and means for detecting an envelope of the transient component Such a system may be used as a pre-process system in an electronic 
system for speech or souad analysis. The methods and systems of the invention may be used within the fields of speech recognition, speech 
synthesizing, narrow band telecommunication, hearing aids, and quality measurement of audio products. 
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METHOD AND SYSTEM FOR DETECTING AND GENERATING TRANSIENT . 
CONDITIONS IN AUDITORY SIGNALS 

The present invention relates to a method and system for 
signal processing, by which method and system features 
5 representing distinct sound pictures in auditory signals are 
extracted from transients in the auditory signals. The result 
of the processing may be used for identification of sound or 
speech signals or for quality measurement of audio products 
or systems, such as loudspeakers, hearing aids, 
10 telecommunication systems, or for quality measurement of 

acoustic conditions. The method of the present invention may 
also be used in connection with speech compression and 
decompression in narrow band telecommunication. 

In the prior art methods of signal analysing of auditory 
15 signals, the signals are considered to be steady state over a 
short time of period, and a form of short time spectral 
analysis is used under this assiimption* 

The human ear has the ability to simultaneously catch fast 
sound signals, detect sound frequencies with great accuracy 
20 and differentiate between sound signals in complicated sound 
environments. For instance it is possible to understand what 
a singer is singing in an accompaniment of musical instru- 
ments . 

In prior art methods of signal analysis and in the method of 
25 the present invention it is assumed that the cochlea in the 
human ear can be regarded as an infinite nximber of bandpass 
filters, IBP, within the frequency range of the human ear. 

The time response f (t) for one bandpass filter due to an 
excitation can be separated into two components, the 
30 transient response, ft(t), and the steady state response, 
fs(t) , 



(1) 



f (t)=ft {t)+fs(t) 
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^ Traditional signal processing is based on the steady state 
response fs(t), and the transient response ft(t) is assxamed 
to vanish very fast and to be without importance for the 
perception, see for example "Principles of Circuit 
5 Synthesis", McGraw-Hill 1959, Ernest 5. Kuh and Donald 0. 
Pederson, page 12, lines 9-15, where it is stated that: 

"only the forced response is considered while the response 
duetto the initial state of the network is ignored". 

Thus, when students are introduced to the world of signal 
10 analysis, they learn at a very early stage that the transient 
response, i*e. the response due to the initial state of the 
network should be ignored because it vanishes within a very 
short period of time. Furthermore, it is rather difficult to 
analyse these transient signals by use of traditional linear 
15 methods of analysis. 

The ability of the human ear to hear very short sounds and at 
the same time detect frecjuencies with great accuracy is in 
conflict with the traditional filterbased spectrum analysis. 
The time window (twice the rise time) of a bandpass filter is 
20 inversely proportional to the bandwidth, 

(2) tw=2/(fu-fl) 

where fl is the lower cutoff frequency and fu is the upper 
cutoff frequency* 

Thus, if a rise time of 5 ms is required the consequence is 
25 that the frequency resolution is no better than 400 Hz. 

As the detection of these transients is in conflict with a 
high frequency resolution, the detecting by the human ear of 
these transients must take place in an alternative manner. It 
has not been examined how the human ear is able to detect 
30 these signals, but it might be possible that the cochlea, 

when no sounds are received, is in a position of rest, where 
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the cochlea will be very broad -banded* When a sound signal is 
received, the cochlea may start to lock itself to the 
frequency component or components within the signal- Thus, 
the cochlea may be broad-banded in its starting position, but 
5 if one or more stable frequencies are received the cochlea., 
may lock itself to this frequency or these frequencies with a 
high accuracy. 

Today it is known that the nerve pulses launched from the , v'.. 
cochlea are synchronized to the frequency of a tone if the 
10 frequency is less than about 1,4 kHz. If the frequency is 

higher than 1,4 kHz the pulses are launched randomly and less 
than once per cycle of the frequency. 

Signal analysis based on filter bank spectrum analysis is 
disclosed in GB 2213623 which describes a system for phoneme 

15 recognition. This system comprises detecting means for 
detecting transient parts of a voice signal, where the 
principal object of the transient detection is the detection 
of a point where the speech spectrum varies most sharply, 
namely, a peak point. The detection of the peak points is 

20 used for a more precise phoneme segmentation. The transient 
analysis of GB 2213623 is based on a spectrum analysis and 
the change in the spectrum, which is very much different to 
the transient analysis of the present invention which is 
based on a direct transient detection in the time domain. 

25 The present invention is based on an approach which is 

different in principle from all known methods for analysing 
auditory signals. According to the invention it has been 
found that the signal information relevant to the 
identification of the auditory signal is present in the 

30 transient component of the signal. Thus, the method of the 
present invention involves a separation of the transient 
component or response of the auditory signal, a generation of 
a transient pulse corresponding to the transient component, 
and analysis of the shape of the pulse. In an auditory 

35 signal, the corresponding transient pulse may be repeated 
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with time intervals, and the time interval of these periodic 
transient pulses is normally also analysed or determined. 



In real life the human ear reacts to energy changes at high 
frequencies in order to recognize phonemes or sound pictures. 
5 But in the present method transient pulses corresponding to 
the energy changes observed by the ear are extracted at these 
high frequencies, whereafter the transient pulses preferably 
are ,transf ormed to the low frequency range still maintaining 
the distinct features of the sound pictures or phonemes. 
10 Thus, by using the principles of the invention, it is 

possible to obtain distinct features within auditory signals 
by examining the transformed low frequency signals. 



As will be understood from the following explanation of the 
method of the invention, the concept of extracting transient 
15 waveforms or shape of pulses makes it possible to use pre- 
process methods which are much simpler than the best designs 
presently used and at the same time obtain much more valuable 
information with respect to the auditory input signals . 

In its broadest aspect, the invention relates to the use of 
20 the shape of energy changes of an auditory signal for 

identifying or representing features which can be perceived 
by an animal ear such as a human ear as representing a 
distinct sound picture. 

Before entering into a more detailed explanation of features 
25 of the method of the invention, a few definitions will be 
given: 

In short time analysis the transient component in a signal is 
a matter of definition. The idea is to obtain an expression 
that gives a response corresponding to the response in the 
30 cochlea to an abrupt change in the signal energy. An abrupt 
change in the signal energy corresponds to the transient 
component in the auditory signal. Thus, in the present 
context, the term "transient component" designates any signal 
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corresponding to an abrupt energy change in an auditory 
signal. The transient component holds the signal information 
to be analysed and in order to analyse this information the 
transient component may be transformed to a corresponding 

.5 transient pulse having a distinct shape. Thus, in the present , ^ 
context, the term "transient pulse" refers to a pulse having 
a distinct shape and substantially holding the information of 
the transient component of the auditory signal and thus 
- corresponding to an abrupt change in the energy of the 

10 auditory signal. As mentioned above the transient part of a 
sound signal may be repeated with time intervals and thus, in 
the present context, the term "periodic" when used in 
combination with a transient component, response or pulse 
designates any transient component, response or pulse being 

15 repeated with intervals. 

The term "shape" designates any arbitrary time-varying 
function (which is time-limited or not time- limited) and 
which, within a given time interval Tp has a distinctly 
different amplitude level in comparison with the amplitude 

20 level outside the interval. Thus, Tp is the duration of the 
shape function when the shape function is time- limited, or 
the duration of the part of the function which has a 
distinctly different amplitude level in comparison with the 
amplitude level outside the time interval . As will be 

25 understood, the identification of the shape of a pulse is 
suitably performed by observing the amplitude of the pulse 
along the time axis of the pulse. 

In order to extract information from the shape of the energy 
changes, one broad aspect of the invention relates to 

30 represent the shape of the energy changes by the shape of a 
transient pulse of the signal. However, several methods can 
be applied in order to obtain a transient pulse corresponding 
to the change in energy, but is is preferred that an envelope 
detection is being used, where the envelope preferably should 

35 be detected from a transient response of the energy change in 
the auditory signal. 
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The energy change representing the distinct sound picture can 
be a phoneme or vowel or any other sound which gives a sudden 
energy change in an auditory signal. 

It is also an aspect of the invention to provide a method for 
5 identifying, in an auditory signal, energy changes which can 
be perceived by an animal ear such as a human ear as 
representing a distinct sound picture, the method comprising 
comparing the^^shape of energy changes of the signal with 
predetermined energy change shapes representing distinct 

10 sound pictures. For the identification it is preferred that 
the shape of the energy changes are represented by the shape 
of a t-ransient^pulse of the signal, and it is furthermore 
preferred that the shape of the transient pulse should be 
obtained by an envelope detection of a transient response of 

15 the energy change in the auditory signal. 

The invention also relates to a method for processing an 
auditory signal so as to reduce the bandwith of the signal 
with substantial retention of the information of the signal, 
comprising extracting the transient component of the auditory 
20 signal and detecting an envelope of the transient component. 
It is preferred that transient pulse shapes of the signal 
which can be perceived by an animal ear such as a human ear 
as representing a distinct sound picture are identified. 

It should be noted that the pulse rise time or the form of 
25 the leading edge, the duration of the pulse, and the fall 
time or the form of the lagging edge are all important 
features for identification of the pulse. In a preferred 
embodiment of the invention the shape of the leading edge of 
a pulse is identified, and it is also preferred that the 
30 shape of the leading edge is determined by determining rise 
time, slope and/or slope variation of at least part of the 
leading edge. 

In a preferred embodiment of the invention, the rise time, 
slope and/or slope variation of at least the top part of the 
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leading edge is determined, since the upper part of the pulse 
should contain the necessary information. The top part may be 
defined as the part beginning substantially at a point where 
the slope is maximum. The top part may also be the part 
5 corresponding to the upper 50% of the amplitude of -the pulse. 

When determining the shape of the pulse several metods may be 
used, but in a preferred embodiment the rise time, slope 
and/or slope variation of the leading edge is determined on 
the basis of at least 5 samples. However any other suitable 
10 number of samples may be used. Another preferred method of 
identification of the shape of the leading edge may be 
performed using comparison with a library of references. 
Here, the references with which comparison is made could be 
selected on the basis of the rise time of the leading edge. 

15 It is also preferred to perform an identification of the 

duration of the pulse, where the duration of a pulse can be 
determined as the distance from the leading edge to the 
lagging edge at a predetermined amplitude. 

As should be understood, it is also preferred to identify the 
20 shape of the lagging edge of the transient pulse. 

The method of the present invention provides an expression 
for the transient conditions of the auditory signal. The 
method comprises a bandpass filtration of an auditory signal 
within the frequency range of the human ear and a detection 
25 of a lowpass filtered envelope, which envelope then can be 
analysed with known methods of signal analysis. The envelope 
is an expression of the transient part of the signal. 

The known method of signal analysis, which should be used 
when analysing the envelope, and the characteristics of the 
30 bandpass filter, which should be selected, . will depend on the 
purpose of the analysis. The purpose may be speech 
recognition, quality -measurement of audio products or 
acoustic conditions, and narrow band telecommunication. 
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The invention also relates to a system for processing an 
auditory signal to reduce the bandwith of the signal with 
substantial retention of the information of the signal, 
comprising means for extracting the transient component of 
5 the auditory sJLgnal, and means for detecting an envelope of 
the transient component. 

—.3 

Embodiments and details of the system appear from the claims 
and the detailed discussion of embodiments of the system 
given in connection with the figures and a mathematical 
10 description of an embodiment of the system. 

The invention wilT^now be described in further detail in 
connection with a mathematical description of the principle 
of the invention and in connection with the drawing. 

Fig. 1 shows the spectre of a bandpass filter F(a)) and a 
15 lowpass filter H(<o) , 

Fig. 2 shows the zeros and the poles in the s-plane for an 
infinite number of bandpass filters, IBP, having identical 
bandwidth, 

Fig, 3 shows the zeros and poles in the s-plane for an 
20 infinite number of bandpass filters, IBP, having identical Q, 

Fig. 4 illustrates the impulse response for various root 
locations in the s-plane, 

Fig. 5 shows a spectrogram for the words "linear prediction", 

Fig. 6 illustrates how a summation of an infinite number of 
25 bandpass filters, IBP, can be performed by one bandpass 
filtration. 

Fig. 7 illustrates the principle of a transient detection 
system according to the invention, 
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Fig, 8 shows a block diagram for a transient detection system 
according to the invention. 

Fig. 9 shows the characteristics of a preferred highpass 
filter.,to be used in the system of Fig- 8, 

5 Fig. 10 shows the characteristics of a preferred lowpass 
filter to be used in the system of Fig. 8, 

Fig. 11 illustrates the sensitivity of the human ear, 

Fig. 12 illustrates average formant frequencies for the 
American vowels /i ( : ) / , /ae ( : ) / , /a ( : ) / , aind /u'( : ) / , 

10 Fig. 13 shows the experimental results of the first transient 
analysis of the vowels of Fig. 11, 

Fig. 14 shows processed curves of the vowel "i" as in "heat". 

Fig. 15 shows similar curves as in Fig. 12 for the vowel "o" 
as in "hop" , 

15 Fig. 16 shows normalized time windows for the processed 
curves of the vowel "i" as in "heat", 

Fig. 17 shows normalized time windows for the vowel "o" as in 
"hop", 

Fig. 18 shows normalized time windows for the vowel "a" as in 
20 "have", 

Fig. 19 shows a block diagram for a speech recognition system 
according to the invention, and 



25 



Figs. 20-25 show transient pulses for speech synthesis of the 
phonemes "i" as in "heat", "o" as in "hop", "o" as in 
"ongaonga", "u" as in the Danish word "hus", "0" as in the 
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Danish word "0se", and "y" as in the Danish word "lys", 
respectively . 

First, a mathematical explanation of the principles of the 
invention is given. .^.^^ 

5 A bandpass filter may be represented in the time domain by an 
impulse response and can be expressed as 

(3) f (t)=h(t)cos(a)ct) 

where h(t) is the impulse response for a lowpass filter and 
is the centre . if requehcy of the bandpass filter f(t).- The 
10 term cos(cact) may be regarded as representing a frequency 
shift of the lowpass filter to a bandpass filter with, a 
centre frequency at w^. This is illustrated in Pig, 1, where 
F(cj) and H(o>) are the corresponding frequency characteristics 
of f (t) and h(t) . 

15 Let the IBP filters be composed of a simple bandpass filter, 
BP, with a zero at origin and two complex poles 
(complementary) in the left half plan of the complex s- plane 
and let the poles of the IBP filters be placed in a straight 
line then: 

20 1) If the bandwidth is identical for all the IPB filters then 
the rise time and the delay time will be identical for all 
filters but Q=:=f c/ (fu-f 1) will be inversely proportional to 
the centre frequency fc. The zeros and the poles are shown in 
Fig. 2. 

25 2) If Q is identical for all filters then the rise time and 
the delay time will be inversely proportional to the centre 
frequency while the bandwidth will be proportional to the 
centre frequency- The zeros and the poles are shown in Pig* 
3 . 
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It is assvuned that the rise time and the delay time are 
identical for the IBP filters within the frequency range 
which is of interest for the analysis of the transient 
conditions. If this is not the case it is assumed that the 
5 brain will compensate for it. The effect is only that the 
rise time will be slower and the delay time will be longer 
with falling frequencies {if Q is identical). The rhythm and 
the shape of the transients will be the same. 



In short time analysis the transient component in a signal is 
10 a matter of definition. The idea is to get an expression that 
gives a response corresponding to the response in the cochlea 
to an abirupt chafi|re in the signal energy. An a]Drupt change in 
the signal energy corresponds to the transient component in 
the auditory signal. 

15 The composition of the transient and the steady state 
component in a signal may be identified by envelope 
detection, where the steady state component is the DC 
component in the detected envelope and the transient 
component is identified as the changes in the level of the 

20 envelope. 

The transient response may be identified by envelope 
detection. 

The envelope of the impulse response can be expressed as 



(4) 




25 where f(t) is the Hilbert transform of f(t). 



By substituting (3) into (4) we have 



(5) 



ft(t)={ [h(t)cos(aJct)]^ + [h(t)cos(a)^tri^ }^ 



For the Hilbert transform we have 
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(6) 



u(t) v(t)=u(t)v(t)=u(t)V(t) 



if the spectra for u(t) and v(t) do not overlap- 



Hence we have 



(7) 



ft(t) = [[h(t)cos(o)cst)]^ + [h(t)sin(a)ct)]2 } 



5 



and 



(8) 



ft(t) = |h(t) I 



based on the assumption that this spectrum for h(t) does riot 
overlap the centre frequency oj^. Under this condition the 
envelope of the impulse response is independent of the centre. 
10 frequency. This is illustrated in Fig. 4 which shows how 

different impulse responses will result in the same envelope. 

The result of (8) causes the total envelope for the IBP 
filters to be the sum of the envelopes for the individual 
bandpass filters. 

15 An accumulated transient response ftt(t) can thus be 

expressed by sinnming ft(t) . This suranation can be expressed 



as 



(9) 




and 



(10) 



ftt(t) = |h(t) I (ojcu - Wci) . 



20 where co^i is the centre frequency for the lower IBP filter 
and cu„„ is the centre frequency for the upper IBP filter. 
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Fig. 5 shows a spectrogram for the words "linear prediction" 
when pronounced by a man. The spectrogram is recorded with 
bandpass filters with a bandwidth of 3 00 Hz and centre 
frequencies in the range from about 150 Hz up to about 4 kHz. 
5^ The ordinate is the- frequency, the abscissa is the time and 
the black ink is a degree of the signal energy. The 
horizontal oriented black bands are dominating frequency 
bands in the speech and are called formants. The vertical 
thin lines corresporiS?^-tfo abrupt energy changes and thus to 

10 the transient components of the signal. A spectrogram is 

usually used for formant analysis and a bandwidth of 300 Hz 
is not sufficient for transient analysis, but the appearance 
of the shape of the liiies confirm that the transient'^ signal 
is independent of the centre frequency of the bandpass 

15 filters. 



As mentioned above the cochlea may be regarded as having an 
infinite number of bandpass filters, but it would be 
advantageous to be able to detect the transient signal 
without the use of a large number of bandpass filters* 

20 Fig, 6 illustrates how a summation of an infinite number of 
bandpass filters, IBP, can be performed by one bandpass 
filtration, BP, having a bandwidth that covers the cutoff 
frequencies of the lower and the upper IBP filter, TB'P^ and 
IBP^, Preferably, the bandpass filter BP should be of the 

25 maximum flat delay type, as this type of filter is well 
suited for preserving the shape of a transient condition . 

In practice the simplest way to detect the envelope is to use 
a rectifier and a lowpass filter, see for example 
"Communication Systems, An introduction to Signal and Noise 

30 in Electrical Communication", McGraw-Hill Kogakusha 1968, A. 
Bruce Carlson, From equation (10) it can be seen that the 
accumulated transient component may be detected by performing 
a highpass filtration, BP, covering the range of IBP that 
needs to be accumulated before the envelope detection. An 

35 envelope detection corresponds to a frequency shift by the 
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centre frequency oj^ bandpass filter to a lowpass 

filter with half the bandwidth of the bandpass filter. This 
means that the cutoff frequency of the lowpass filter 
determines the bandwidth of all the IBP covered by the BP. 
5 This principle is illustrated ira-Fig. 7. 



In Fig. 7 the digitalized sound signal S{t) enters a bandpass 
or highpass filter BP, 10, the output of the bandpass filter 
is input into a rectifying unit ll^- the output of which is 
input into a lowpass filter LP, 12. The output of the lowpass 
10 filter 12 is designated ftt{t) and represents a detection of 
the envelope and thus a detection of the transient response 
of the sound signal S(t). 

From the mathematical definition of a transient part of a 
signal it can be concluded that the poles of h(t) will be 
15 located on the negative reel axis in the s-plane. This means 
that the impulse response will not be oscillating around zero 
(a transient response is a non oscillating signal) . From 
equation (10) it can be seen that the limits ci)^^ and w^i for 
the IBP filters is only a question of quantity of ftt{t). 



20 The bandpass filtration, BP, sets the limits for the 

summation of the transient responses of the IBP filters, and 
the amplitude characteristic weights the contribution from 
the IBP filters. If a lowpass filter is used instead of BP, 
there will be an overlap of the spectrum for h(t) and the 

25 centre frequency for the lower IPB filter. The bandpass 

filter BP should have a band width which at least equals the 
double of the cutoff frequency of the lowpass filter LP. The 
band width and the amplitude characteristic can be utilized 
for optimizing different signal analyses when using the 

30 method according to the invention. 

In principle the poles of the lowpass filter LP should be 
located on the negative reel axis for a mathematical 
transient detecting system. However, when dealing with 
auditory signals, it is the characteristic of the cochlea 
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which is decisive; but there should preferably be no 
significant oscillations within the impulse response, as this 
could make the transient conditions of the auditory signal 
more indistinct. 

5 The cutoff frequency of the lowpass filter LP is an 

expression for the transient^ conditions of the signal, and 
this frequency should in connection with auditory signals 
result in a rise time corresponding to the rise time of the 
cochlea. The cutoff frequency may be regarded as an index of 
10 transients, where a low cutoff frequency will result in 

transient detection of only those signal elements having a 
slow rise time, and'^where a'ffigh cutoff frequency also will 
result in detection of signal elements having a fast rise 
t ime . 



15 The fact that the nerve pulses from the ear are synchronized 
to the frequency below about 1.4 kHz and not above indicates 
that the ear is tone oriented below 1.4 kHz and transient 
oriented above. In the transient oriented area the nerve 
pulses are synchronized to transients, corresponding to 

20 abrupt energy changes, in the signal. 

The cutoff frequencies for the BP should correspond to the 
transient sensitive range for the cochlea (theoretically it 
should have an amplitude characteristic corresponding to the 
25 sensitive curve for the ear) . The sensitivity curve for the 
human hearing indicates that the lower cutoff frequency must 
be about 2 kHz and the upper about 5 kHz. The amplitude 
characteristic for the BP filter will weight the 
contributions from the individual IBP filters. 

30 From the above discussion a transient detection and analysis 
system according to the invention may t>e constructed as shown 
in the block diagram of Fig. 8. In Fig. 8 a sound signal is 
input into a microphone 13 the output of which is passed 
through a lowpass filter 14 before being digitalized by an 

35 A/D converter 15. The output of the A/D converter S(t) is 
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lead to a highpass or bandpass filter BP, 10, the output of 
the bandpass filter is input into a rectifying unit li the 
output of which is input into a lowpass filter LP, 12, see 
also Fig. 7. The output of the lowpass filter 12 is 
5 designated ftt(t) and represents the^'transient components of 
the input signal. In order to analyse the transient 
components, the output signal of the lowpass filter 12 should 
preferably be lead into equipment for signal analysis or 
recognition 16. .3-^^' 

10 Figs. 9 and 10 show the characteristics of a preferred 

highpass filter and lowpass filter to be used in the systems 
of Figs. 7 or 8. The bandpass filter BP to be used as the 
highpass filter 10 in Figs. 7 or 8 should have a lower cutoff 
frequency of at least 2000 Hz, preferably about 3000 Hz. The 

15 upper cutoff frequency should be in the range between 4500 
and 7000 Hz, preferably about 6000 Hz. The characteristic 
shown in Fig. 9 has a lower cutoff frequency of 3014 Hz. The 
lowpass filter LP to be used in Figs. 7 or 8 should have a 
higher cutoff frequency in the range of 400-1200 Hz, 

20 preferably about 700 Hz. The characteristic shown in Fig. 10 
has a higher cutoff frequency of 732 Hz. It would also be 
possible to construct a transient detection system according 
to Figs. 7 or 8 by using a full-wave rectifier. However, it 
is preferred to use a one-way rectifier as illustrated in 

25 Figs. 7 and 8. 

In Fig. 11 the sensitivity of the human ear is illustrated as 
the response of the cochlea on auditory signals for tones is 
shown. As already mentioned the perception is tone oriented 
up to about 1.4 kHz and transient oriented above 1,4 kHz. 

30 As mentioned above and illustrated in Fig. 6 the total 

envelope for the IBP filters is obtained by a summation of 
the envelopes of the individual bandpass filters, and the 
summation of an infinite or high number of bandpass filters 
IBP can be performed by one bandpass filtration BP. This 

35 principle is used in the diagram shown in Fig. 7. However, a 
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siimmation of a number of bandpass filters may also be 
realized by using a filter bank method in which the envelopes 
of a number of individual bandpass filters are detected and 
summed. Thus, each branch within the filter bank is composed 
5 of a bandpass filter with a specific centre frequency, a 

rectifying unit and a lowpass filter, and the outputs of the 
lowpass filtiers are summed in order to obtain the total 
envelope. 

Now, some introductory experiments illustrated by Figs. 12 
10 and 13 will be discussed: 

Two experiments were carri^i^d out order to evaluate the 
cutoff frequencies for the BP and the LP filters and to 
evaluate the suitability of the method for speech 
recognition. 

15 1. Experiment by listening to an amplitude modulated signal 

To have a first indication of the cutoff frequency for the LP 
filter under controlled conditions, a listening experiment 
was carried out with an amplitude modulated signal in the 
sensitive frequency range for the ear. The experiment is 
20 somewhat artificial because normally there would not be so 
intensive a signal in that range and it can not be 
recommended to verify the experiment because it is very hard 
to the ear. 

The carrier frequency was chosen to 3.5 kHz and the 
25 modulation tone was tuned up from a few Hz and upwards. Until 
350 - 400 Hz the envelope signal sounds buzz. After that it 
sounds first like a hollow /u{:)/ and at 800 Hz like a sharp 
/i{:)/. Above 800 Hz it was not possible to hear the envelope 
signal. If the tone is increased further at a given point one 
30 will hear different mixed tones. 
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The sound was of course dominated by the carrier frequency 
but it was indicated that the cutoff frequency for the LP 
filter probably has to be less than 1-1.2 kHz. 

The modulation index was about 0.75. When it^^is greater than 
5 1, the introduction of overtones can be observed. 

2. Analysis of transient signals for four vowels 

Selection of vowels: 

Fig. 12 shows average formant frequencies for the American 
vowels /i(:)/, /aB{:)/, /a(:)/, and /u(:)7 as in heed, had, 
10 hod, and who'd for men, women, and children. These vowels 

represent a good dispersal among vowels so they were selected 
to the experiment. 

The vowels were recorded (with Danish accent) pronounced of a 
man, a woman, and a child by an ordinary cassette recorder. 

15 Setup for the experiment: 

An analog TSD (Transient Signal Detector) was designed in 
accordance"^ with Fig. 7. The design was based on the 
operational amplifier LM 833. 

The specification for the filters were: 

20 The BP filter was a four orders Chebyshev filter with 1 db 
ripple. The upper cutoff frequency is about 6.5 kHz and the 
lower is adjustable from about 550 Hz to 2.6 kHz. 

The rectifier was a full rectifier that converts the negative 
signal and adds it to the positive signal. 

25 The LP filter was a two orders Butterworth filter designed to 
have a cutoff frequency at 1.5 kHz (the 3 db cutoff frequency 
was measured to 2.1 kHz) . 
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Recording vowels and detecting the transient signal : 

Four vowels pronounced by a man, a woman, and a child were 
recorded on an ordinary radio cassette recorder. The 
transient signal was detected by rnggns of the TSD, converted, 
5 and stored on PC by means of an 8 bits A/D converter. The 
sampling rate when recording was 10 kHz^^. but when analysing 
the recorded data only every second set of values was 
considered, resulting in a sampling .xater^ of 5 kHz* An 8 bits 
A/D converter gives a poor dynamic range and therefore it was 
10 necessary to record the vowels isolated (that means not in a 
word) and this gives a more uncertain pronunciation- 

Figs, 13a'13p show the experimental results of the first 
transient analysis of the vowels of Fig. 12* 

It is possible to identify the vowel by listening to the 
15 transient signal. By visual inspection of time variation of 
the results it could be observed that the same vowel 
pronounced by a man, a woman, and a child, respectively, was 
having almost the same characteristics, even if differences 
in the fundamental tone were observed. When recording the 
20 vowel /ail) / as in the Danish word "op", a p- sound was also 
recorded which is clearly seen from the time variation of the 
transient signal. 

Analysis of the transient signals: 

The power in the transient signals varies a lot from vowel to 
25 vowel. The signals of the vowels /a(:)/ and /u(:)/ were very 
low (especially for the man's voice) and it was necessary to 
turn up the volume for the radio cassette recorder to a high 
level and it caused a lot of noise. 

First, there were made a nximber of FFT analysis of 20 ms 
3 0 duration and a 5 Khz sampling rate at different starting 
points in the vowels. The spectra appear to be very 
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outstanding and identical throughout the vowel. This strongly 
indicates that there is important infoirmation in the signal. 

In order to analyse common features 20 ms (101 samples) were 
randomly chosen from each vowel. The time signala^were 
5 smoothed by a Hamming window and the FFT's were calculated. 
In Figs. 13a- 13d the power spectra are shown where the, three 
voices are illustrated in the same diagram for each vowel and 
the corresponding transient signals are shown separately in 
Figs. 13e-13h when pronounced by a woman, in Figs. 13 i- 131 
10 when pronounced by a man and in Figs. 13m- 13p when pronounced 
by a child. 

The spectra are expected to have the following features: 

The spectra of the same vowel pronounced by three different 
voices will have some common features related to the vowel 
15 and some features related to the voice. 

The spectra of different vowels pronounced by the same voice 
will have some features related to the different vowels and 
some common features from the voices. 

Furthermore, it must be expected that the shape of the 
20 spectra plays a more important part than the absolute 
frequencies . 

From the power spectra the following can be seen: 
/i(:)/ (Fig. 13a) 

The most remarkable feature is that the spectra from all 
25 three have an outstanding top in the frequency range from 

300-400 Hz, they are 50 Hz wide, and there are an outstanding 
cleft at 200-250 Hz, Furthermore, there is a contribution at 
50 Hz. The man's voice has a contribution at 150 Hz which 
must attribute to a deep voice. 
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The voices of the woman and of the man have an outstanding 
cleft at 350 Hz (deeper than 50 db) . The mans voice lias also 
in this case a contribution at 150 Hz; The.. voice of the child 
5 does not fit so well into the pattern, this might perhaps be 
due to an uncertain pronunciation. 

/a(:)/ (Fig. 13c) '-...i:^' 

All three voices have top 250-300 Hz. The frequency range is 
a bit lower and not so outstanding as for the /i(:)/. 
10 Further, there is major contribution at 50 Hz and below for 
all three voices. 

/u(:)/ (Fig. 13d) 

The voices of the child and of the woman are real alike and 
they have a peak at 300 and 350 Hz and they have a deep wide 
15 valley at 100 Hz. The man's voice has also a peak and the 
valley is as wide as it is for the woman and the child but 
not so deep. The reason for this can be the deep voice and 
the fact that there is a lot of noise in the signal caused by 
the radio cassette recorder. 

20 The experiments leading to the results of Figs. 13a-p can be 
seen as introductory but the results are highly interesting 
especially when taking into consideration the simple 
equipment that has been used with a lot of noise and only 8 
bit A/D -converter. In spite of this the results are 

25 outstanding. There has been no particular data selection to 
improve the results and there is therefore no doubt that the 
transient condition is of decisive importance for speech 
recognition. 

It seems like all information might be located in the 
30 frequency range below 500 Hz. If this is the case then the 
demand on the sampling frequency will be less than 1.5 kHz 
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and it will be possible to analyse the speech signal very 
intensively with more parallel processes. It is possible to 
have more time windows for instance 5, 20, and 40 ms and use 
spectrum analysis' (FFT, LPC, CEPSTRDM, or others) to detect 
5 some phonemes and time analysis (correlation or methods) to 
detect others phonemes . 

It is most likely that a more sophisticated design of the TSD 
with an AGC amplifier as preamplifier and a logarithmic or 
AGC amplifier after the BP filter in order to compensate for 
10 variations in the energy of the bandpass filtered phonemes, 
will allow very good results to be obtained and cause a very 
robust speaker independent speech recognition. Better results 
may be obtained if a 12 or 16 bit A/D converter is used 
instead of the 8 bit A/D converter. 

15 Further experimental results illustrated in Figs. 14-18 will 
be discussed in the following: 

The method of extracting transient signal components 
according to the present invention may also be regarded as a 
pre-process of the auditory input signal. In order to be able 
20 to obtain a better understanding and/or determination of the 
parameters of the pre-process a software programme were 
developed, by use of which it is possible to show the output 
signals and listen to the outcome after each process step of 
the pre-process. 

25 The analysis of speech 'signals shown in Figs. 14 and 15 has 
been made by means of this software programme running on a 
Compaq Deskpro 4/66i PC. This type of PC is provided with 
Microsoft Windows Sound System, a microphone and a codec chip 
{AD1848) from Analog Devices. The codec chip performs the 

3 0 sampling, the anti aliasing filtration and the A/D 
conversion. 

The speech signals shown in Figs. 14a and 15a are recorded by 
means of this Sound System, The speech signal is sampled with 
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11025 kHz and l6 bits linear PCM. The passband is greater 
than 4.9 kHz. 

Pretransient signals are shown in Figs. 14b and 15b. These 
-signals are the speech signals filtered by a third order IIR 
5 digital highpass filter with a cutoff frequency at 3.0 kHz. 
The filter is a bilinear transformation of a third -order 
Butterworth filter. 

The cutoff frequency at 3.0 kHz has been chosen to get the 
bandpass in the range of the most sensitive area of the 
10 cochlea. In this case it means from 3.0 kHz to 4.9 kHz, where 
4.9 kHz is given by the codec chip. The high- or bandpass 
filter will be optimal if it has maximum flat delay 
characteristic in accordance with equation (10) . 

The transient signals shown in Pigs. 14c and 15c are the 
15 pretransient signal rectified and filtered by a second order 
IIR digital lowpass filter with a cutoff frequency at about 
700 Hz. The filter is a bilinear transformation of a second 
order Butterworth filter. 

The lowpass filter shall preserve the shape of the transient 
20 pulse corresponding to a transient response in the cochlea, 
so that a filter which is able to do this will be an optimal 
filter. The nerves in the cochlea are able to launch nerve 
pulses with a frequency up to about 1.4 kHz. A bandwidth for 
the IBP filters in the transient oriented area at 1.4 kHz are 
25 transformed by the envelope detection to a cutoff frequency 
for a lowpass filter at 700 Hz, which is the reason why a 
cutoff frequency at about 700 Hz has been chosen. 

The transient signal may be regarded as an expression for the 
energy change in the signal. 

30 All the signals presented in Figs. 14 and 15 are normalized 
to a maximum signal level, which means that the largest 
absolute signal value is equal to 32766, The abscissas in 
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Figs. 14 and 15 represent a time interval of 50 ms and the 
ordinates in Figs. 14a, 15a and Pigs. 14b, 15b represent the 
sound pressure of the corresponding speech signal whereas the 
ordinates of Figs. 14c, 15c represent the energy of the 
5 corresponding transient speech signal. 

. It is possible to listen to the speech, the pretransient and 
the transient signals, corresponding to Figs, 14a, 15a, 14b, 
15b and 14c, 15c, respectively. One of the main demands for 
selecting the filter characteristics is that the signals have 
10 to maintain a sound which is close to the original speech 
signal when listening to the above mentioned signals. 

Referring to the system illustrated in Fig. 7, Fig. 14 shows 
curves of the vowel "i" as in "heat", when pronounced by a 
man, where (a) shows the speech signal before filtration 

15 corresponding to the digitalized input signal S(t) in Fig. 7, 
(b) shows the signal after a highpass filtration 
corresponding to the output signal of the bandpass filter 10 
in Fig. 7, and (c) shows the signal after rectifying and 
lowpass filtering corresponding to the output signal of the 

20 lowpass filter 12 in Fig. 7. 

Fig. 15 shows similar curves as in Fig. 14 for the vowel "o" 
as in "hop", 

The rise and fall time and the width or duration of the 
transient pulse is observed to be of importance for the sound 

25 in a vowel. Figs* 16-18 give examples of measured transient 
pulses. The time window of the vowel "i" as in "heat", when 
pronounced by a man, shown in Fig. 16a corresponds to the 
processed signal shown in Fig, 14c. The corresponding time 
window when the vowel "i" as in "heat" is pronounced by a 

30 child is shown in Fig. 16b, From Figs. 16a and 16b it can be 
observed that the leading and lagging edges of the most 
dominant pulses are sharp with a rise and fall time in about 
0.4 ms or less and that the width of the dominant pulses is 
about 0.8 ms when measured at the level of about 50 %. 
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The time window of the vowel "o" as in "hop", when pronounced 
by a man, shown in Fig. 17a corresponds to the processed 
signal shown in Fig, 15c. The corresponding time window when 
the vowel "o" as in "hop" is pronounced by a child is shown 
5 in Fig. 17b. From Figs. 17a and 17b it can be observed, that 
the leading and lagging edges of the most dominant pulses are 
sharp with a rise and fall time in about 0.5 ms but the width 
of the dominant pulses is about 1.5 ms when measured at the 
level about 50 %. The ditch in the dominant pulses of Fi^g^ 
10 17b is not deep enough to influence the perception. It should 
be noted that the vowel "o" as in "hop" is a sharp vowel, and 
a more soft vowel will have a more slow lagging edge. 

Fig. 18 shows the time window for the processed signal of the 
vowel "a" as in "have" when pronounced by a man. it is to be 
15 observed that the shape of the transient pulse has softer 
leading and lagging edges than the pulses shown in Figs. 
16-17. 

Thus, from the above results it may be concluded that the 
perception of a vowel is given by the shape of the transient 

20 pulse. It is further to be concluded that by analysing the 

transient components or pulses which have been extracted from 
the auditory signal by way of the above mentioned method of 
signal processing, the vowels or phonemes of the speech 
signal may be recognised by identifying the shape of the 

25 transient pulse or pulses. 

In a vowel or phoneme the transient pulse is repeated and the 
repetition frequency gives the perception of the pitch. In 
Fig. 16a the time period between two succeeding pulses is 
about 6 ms corresponding to a man's pitch at 170 Hz and in 
30 Fig. 16b the time period between two succeeding pulses is 
about 3.5 ms corresponding to a child's pitch at 280 Hz 



Thus, it is also to be concluded that by analysing the 
transient component or pulses which have been extracted from 
the auditory signal by way of the above mentioned method of 
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signal pirocessing, the pitch of the speech signal may be 
determined by determining the time period between the 
transient pulses • 

Thus, when analysing auditory signals according to a 
5 preferred embodiment of the present invention, it is taken 
into account that the identity of the sound signal is 
preserved during the signal processing which includes a 
highpass filtration followed by a rectification and a lowpass 
filtration of the input signal. 

10 From the above discussion it should be understood that the 
pre¥ent invention provides a method which is very suitable 
for use in speech recognition* 

Fig, 19 shows a block diagram for a speech recognition system 
according to the invention. In this system a pre-process unit 

15 20 is provided which comprises the bandpass filter 10, 

rectifying circuit 11 and lowpass filter 12 of Fig. 7. Thus, 
the pre-process unit, which most conveniently may be 
integrated within a single integrated circuit or chip, is a 
transient detecting unit in accordance with the method of the 

20 present invention. The system further comprises units which 
are normally used in speech recognition systems, such as a 
pattern recognition unit 21 connected to a reference library 
22, a unit for phoneme determination 23 and a unit for 
word/sentence determination 24. The system shown in Fig. 19 

25 uses template matching but alternative approaches may be used 
in a recognition system. 

The reference library 22 of Fig. 19 should store a library 
corresponding to the shapes which can be generated by the 
pre-process unit 20. 

30 It should be understood that a single chip pre-process unit 
also may comprise the lowpass filter 14 and or the A/D 
converter 15 as shown in Fig. 8. 
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It is to be understood that a pre-process according to the 
present invention could be used in many other electronic 
systems where speech or sound analysis, recognition, coding 
and/or decoding is required, such as quality measurement of 
5 audio products or systems, such as loudspeakers, hearing - . 
aids, and telecommunication systems, or for quality 
measurement of acoustic conditions. The pre-process may also 
be used in connection with speech compression and 
r?^;- decompression in narrow band telecommunication. ^ 



10 As illustrated in Fig. 10 the preferred cutoff frequency of 
the lowpass filter 12 used in a pre-process unit should be 
below 1 kHz. Thus, all the necessary signal information of 
the auditory signals is represented within a rather narrow 
frequency range of 1 kHz. This should be compared to the 

15 frequency band of around 9000 bits per second which is used 
within the GSM mobile telecommunication system for the 
communication of speech signals. By using the pre-process 
method or unit of the present invention it should be possible 
to decrease the frequency band used for telecommunication 

20 down to about 1000 bits per second which would result in 
great savings within this area of communication. 

Thus, it should be understood that the present method is very 
well suited for optimizing the bandwidth within narrow band 
telecommunicaton and it is within the scope of the invention 

25 that when transmitting an auditory signal in a 

telecommunication system, the signal should be processed by 
using the pre-process described herein before being 
transmitted and received by a receiver. It it preferred that 
prior to transmission of the processed signal, the signal is 

3 0 coded into a digital representation, and the coded signal is 
decoded in the receiver so as to reestablish transient pulse 
shapes perceived by the animal ear such as the human ear as 
representing the distinct sound pictures of the auditory 
signal . 
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During the above mentioned digital transmission the bandwidth 
may be chosen so as to fulfil different requirements to the 
quality of the received, decoded and reestablished transient 
pulse. Thus, a bandwidth of at the most 4000 bits per second 
5. may . be selected, but it should be possible to obtain a good 
quality of the reestablished pulse by using a bandwidth 
around 2000 bits per second. However, it is preferred that 
the bandwith is in the interval of 800-2000 bits per second. 
It is^|:^o^.be noted that for telecommunicating systems where a 
10 high system performance is preferred as opposed to a high 
quality of the reestablished signal, such as for example in 
military systems, a bandwidth about 400 bits per second may 
be. selected. 

When transmitting the digital signals it is preferred that 
15 the digital information comprises information about leading 
edge, lagging edge, and duration of the transient pulse 
representing the processed, auditory.. signal. It is also 
preferred that a second and further pulses in a sequence of 
identical pulses are represented by a digital sign indicating 
20 repetition when transmitted. 

It is also an object of the present invention to provide a 
method to be used in speech synthesis. 

From the discussion of the experimental results of Figs. 
14-18 it should be understood that the sound of each vowel or 

25 phoneme might be given by the shape of a dominating transient 
pulse corresponding specifically to that phoneme. From 
experiments it has been concluded that transient pulses 
similar to the processed pulses of Figs. 16-18 hold the 
necessary information in order to generate the sound of the 

3 0 phoneme . 

By use of the software developed for the transient analysis 
illustrated in Figs. 14-18 it is possible to create a simple 
transient signal by placing points in a system of coordinates 
where the ordinate is the amplitude and the abscissa is the 
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time in ms. One transient pulse may be created by placing one 
or several points and interpolate a line between the points 
either by a straight line or a sine curve and define a 
period. The signal is repeated for 300 ms and it is possible 
-5 to listen to the signal when converted by a D/A converter in 
the codec chip. 

It should be noted that the pulse rise time or the form of 
V the leading edge, the duration of the pulse, and the fall 
time or the form of the lagging edge are all important 
10 features for identification, representation and/or generation 
of transient pulses for use in speech recognition and/or 
synthesis. These features may also be used in connection with 
speech compression. 

This is illustrated in Figs. 20-25 which show how transient 
15 pulses used for speech synthesis or identification should be 
formed for the phonemes "i" as in "heat", "o" as in "hop", 
"o" as in "ongaonga" or as in the Danish word "Ole", "u" as 
in the word "who", "0" as in the Danish word "0se", and "y" 
as in the Danish word "lys", respectively. The pulses are 
20 repeated within a period of 5 ms. 

From Fig. 20 it can be seen that the phoneme "i" as in "heat" 
could be formed by a very short pulse having a duration in 
the range of 0.3-1.1 ms, with a rise time of the leading edge 
being in the range of 0.3-0,5 ms. The fall time of the 
25 lagging edge should also be in the range of 0.3-0.5 ms. 

Similarly it is observed from Fig. 21 that the phoneme "o" as 
in "hop" could be formed by a pulse having a duration in the 
range of 1,3-1.8 ms, with a rise time of the leading edge 
being in the range of 0.3-0.5 ms. The fall time of the 
3 0 lagging edge should be in the range of 0.3-0.5 ms. 

From Fig. 22 it is observed that the phoneme "o" as in the 
Danish word "Ole" could be formed by a pulse having a 
duration in the range of 1,3-1.8 ms in the upper part of the 
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pulse, with a rise time of the leading edge being in the 
range of 0,3-0.5 ms. The fall time of the lagging edge for 
this phoneme may vary, but should be in the range of 1.0-2,0 
ms. 

5 From Fig. 23 it is observed that the phoneme "u" as in the 
word "who" could be formed by generating a transient pulse 
with a sine curve interpolation and a duration in the range 
of 1. 0-2 .,0,^ms.v^.#The preferred duration should be about 1.5 ms. 

Fig. 24 show the pulse of the phoneme "0" as in the Danish 
10 word "0se". Here the leading edge may have a rise time in the 
range .of 0.4-0^6 ms. The fall time of the lagging edge should 
be in the range 1.0-2,0 ms * 



Fig, 25 show the pulse of the phoneme "y" as in the Danish 
word "lys". Here the leading edge may have a rise time in the 
15 range of 1.0-2.0 ms. The fall time of the lagging edge should 
also be in the range 1,0-2.0 ms. 

When synthesizing human speech in accordance with the above 
mentioned principles of the invention it is preferred to 
generate a series of transient pulses corresponding to the 
20 series of phonemes which constitutes the speech to be 

synthesized. It is furthermore preferred that the series of 
phonemes is established from a series of letters using rule- 
based conversion. 

It should be understood that the principles of the invention 
25 also can be used for quality measurement of audio products. 
In such a measurement a well defined transient signal should 
be transmitted to the audio product, and the distorsion of 
the response can be measured. The distorsion may be measured 
by using a pre-process in accordance with the principles 
30 illustrated in Fig. 7. 

The principles of the invention may also be used in hearing 
aids in order to improve noise suppresion in speech signals. 
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A library of features representing characteristic shapes of 
the transient pulses may be used for identifying the speech 
signal and separate the speech signal from the noise 
background . 

5 The experiments presented have, for the first time, shown 
some common features for phonemes whicti are very simple to 
recognize and generate, but which could be of great 
significance within the whole area of recognition and 
generation of speech or auditory signals. 



10 The performance of the method and system of the present 
^ invention is described in the time domaine. It is however to 
be understood that the transient signals, components and/or 
pulses being described in the time domaine also could be 
given a corresponding description in the frequency domaine, 

15 which would naturally be within the scope of the invention. 

It is also to be noted that the methods of signal processing 
described above could be performed either digitally, 
electronically by use of analog components, mechanically, or 
by any combination thereof. Such methods of processing would 
20 also be within the scope of the invention. 
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CIiAlMS 

1. The use of the shape of energy changes of an auditory 
signal for identifying or representing features which can be 
perceived by an; animal ear such as a human ear as 

5 representing a distinct sound picture. 

2. The use according to claim 1, wherein the shape of the 
energy changes ofJjcXiB auditory signal is represented by the 
shape of a transient pulse of the signal. 

3 . The use according to claim 2 , wherein the shape of a 

10 transient pulse is obtained by use of an envelope detection. 

4. The use according to any of the preceding claims, wherein 
the distinct sound picture is a phoneme. 

5. A method for identifying, in an auditory signal, energy 
changes which can be perceived by an animal ear such as a 

15 hioman ear as representing a distinct sound picture, the 

method comprising comparing the shape of energy changes of 
the signal with predetermined energy change shapes 
representing distinct sound pictures. 

6. A method according to claim 5, wherein the shape of the 
20 energy changes are represented by the shape of a transient 

pulse of the signal . 

7. A method according to claim 6, wherein the shape of a 
transient pulse is obtained by an envelope detection of a 
transient response of the energy change in the auditory 

25 signal. 

8. A method for processing an auditory signal to reduce the 
bandwith of the signal with substantial retention of the 
information of the signal, comprising extracting the 

30 transient component of the auditory signal and detecting an 
envelope of the transient component. 
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9. A method according to claim 8, wherein transient pulse 
shapes of the signal which can be perceived by an animal ear 
such as a h\iman ear as representing a distinct sound picture 
are identified. 

5 10. A method according to claim 9, wherein the distinct sound 
picture is a phoneme. 

11. A meth<^d^according to claim 6 or* 9, wherein the shape of 
the leading edge of a pulse is identified. 

12. A method according to claim 11, wherein the shape of the 
10 leading ed^^*"is determined by determiningf' rise time, slope 

and/or slope variation of at least part of the leading edge. 

13. A method according to claim 12, wherein the rise time, 
slope and/or slope variation of at least the top part of the 
leading edge is determined. 

15 14. A method according to claim 13, wherein the top part is 
the part beginning substantially at a point where the slope 
is maximum. 

15. A method according to claim 12, wherein the rise time, 
slope and/or slope variation of the leading edge is 

20 determined on the basis of at least 5 samples . 

16. A method according to any of claims 11-15, wherein the 
identification of the shape of the leading edge is performed 
using comparison with a library of references, 

17. A method according to claim 16, wherein the references 
25 with which comparison is made are selected on the basis of 

the rise time of the leading edge. 

18 . A method according to claim 6 or 9 , wherein the duration 
of a pulse is identified. 
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19. A method according to claim 18, wherein the duration of a 
pulse is determined as the distance from the leading edge to 
the lagging edge at a predetermined amplitude. 

20. A method according, to claim 19, wherein the predetermined 
5 amplitude is an amplitude of at the most 50% of the maximum 

amplitude of the pulse. 

21. A method according^*xfo^""any of claims 11-20 wherein pulses 
which cannot be perceived by the animal ear are discarded 
from the identification. 

10 22. A method according td'^claim 21, wherein a pulse the 

leading edge of which has an amplitude of less than 50% of 
the amplitude of the amplitude of the preceding pulse and an 
onset time of less than 3.5 ms is disregarded* 

23. A method according to any of claims 11-22, wherein the 
15 shape of the lagging edge of a pulse is identified. 

24. A method according to claim 23, wherein the shape of the 
lagging edge is determined by determining fall time, slope 
and/or slope variation of at least part of the leading edge. 

25. A method according to any of claims 11-23, wherein the 
20 time period between leading edges of pulses which can be 

perceived by the animal ear is determined. 

26. A method according to claim 25, wherein the time period 
between leading edges which have a distance of at least 3 ms 
from each other is determined. 

25 27. A method for telecommunicating an auditory signal, 

comprising processing the signal by the method according to 
any of claims 8-26, transmitting the processed signal, and 
receiving the processed signal by a receiver. 
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28. A method according to claim 27, wherein, prior to 
transmission of the processed signal, the signal is coded 
into a digital representation, and the coded signal is 
decoded in the receiver so as to reestablish transient pulse 

5 shapes perceived by the animal ear such as the human ear as 
representing the distinct sound pictures of the auditory 
signal. 

29. A method '#^lording to claim 28, wherein the digital 
transmission is performed at a bandwidth of at the most 4000 

10 bits per second. 

30. A method accoi?ciing to claim 29, wherein the"" bandwith is 
at the most 2000 bits per second. 

31* A method according to claim 30, wherein the bandwith is 
in the interval of 800-2000 bits per second. 

15 32. A method according to any of claims 28-31, wherein the 

digital information comprises information about leading edge, 
lagging edge, and duration of the transient pulse, 

33* A method according to any of claims 28-32, wherein a the 
second and further pulses in a sequence of identical pulses 
20 are represented by a digital sign indicating repetition. 

34. A method according to any of the claims 8-26, wherein the 
extraction of transient component comprises a bandpass 
filtration or a highpass filtration. 

35. A method according to any of the claims 8-26 or 34, 

25 wherein the envelope detection comprises a rectification and 
a lowpass filtration, 

36. A method according to claim 34, wherein the lower cutoff 
frequency of the bandpass or highpass filtration is at least 
2 kHz, such as about 3 kHz. 



wo 94/25958 



PCT/DK94/00164 



36 

37. A method according to claim 34 or 36, wherein the upper 
cutoff frecjuency is in the range between 4.5 and 7 kHz, 
preferably about 6 kHz. 

38. A method according to-claim 35, wherein the 
5 rectification is a one-way rectification. 

39. A method according to claims 35 or 38, wherein the cutoff 
frequency of the lowpass filtfea'tion is in the range of 400- 
1000 Hz, preferably about 700 Hz. 

40. A method according to any of the claims 8-26 or 34, 

10 wherein the envelope detection "comprises bandpass filtration 
by use of a bank of filters. 

41. A method of identifying or representing the phoneme "i" 
as in "heat", comprising identifying or generating a 
transient pulse with a rise time of the leading edge of at 

15 the most 0.5 ms and a duration of at the most l.l ms. 

42. A method according to claim 41, wherein the rise time of 
the leading edge is at the most 0.4 ms, preferably at the 
most 0.3 ms . 

43. A method according to claim 41 or 42, wherein the 

20 duration is at the most 1-0 ms, preferably about 0.8 ms, 

44. A method of identifying or representing the phoneme "o" 
as in "hop", comprising identifying or generating a transient 
pulse with a rise time of the leading edge of at the most 0.5 
ms and a duration of 1.3-1.8 ms. 

25 45. A method according to claim 44, wherein the rise time of 
the leading edge is at the most 0.4 ms, preferably at the 
most 0.3 ms. 
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46. A method according to claim 41 or 42, wherein the fall 
time of the lagging edge is at the most 0.5 ms, preferably at 
the most 0.4 ms and more preferably at the most 0.3 ms. 

47. A method of identifying or representing the phoneme "o" 
5 as in the English word "ongaonga" or the Danish word "Ole", 

comprising identifying or generating a transient, pulse with a 
rise time of the leading edge of at the most 0 . 5 ms and a 
duration of l.3-1.8^mi^^~ 

48. A method or identifying or representing the phoneme "u" 
10 as in the English word "who", comprising identifying or 

generating a transient pulse with a sine curve interpolation 
and a duration of at 1,0-2,0 ms, preferably about 1.5 ms. 

49. A method according to any of the claims 1-26 or 41-48, 
when used in speech recognition. 

15 50- A method according to any of the claims 1-7 or 41-48, 
used in speech compression. 

51. A method according to any of the claims 1-7 or 41-48, 
when used for synthesizing human speech, comprising 
generating a series of transient pulses corresponding to the 

20 series of phonemes which constitutes the speech to be 
synthesized. 

52. A method according to claim 51, wherein the series of 
phonemes is established from a series of letters using rule- 
based conversion. 

25 53. A method according to any of the claims 1-7 or 41-48, 
used in quality -measurement of audio products, the audio 
products preferably being loudspeakers, hearing aids or 
telecommunication systems. 
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54. A method according to any of the claims 1-7 or 41-48, 
used in quality-measurement of acoustic conditions in a room 
or in the open. 

55. A system for processing an auditory signal to reduce the 
5 bandwith of the signal with substantial retention of the 

information of the signal, comprising means for extracting 

the transient component of the auditory signal, and 

means for detecting an envelope ofVjthe transient component. 

56. A system according to claim 55 > further comprising means 
10 for identifying or representing the energy changes on the 

basis of the shape of the transient pulses. 

57. A system according to claims 55 or 56, wherein the means 
for transient component extraction comprises a bandpass 
filter or a highpass filter. 

15 58. A system according to any of the claims 55-57, wherein 
the envelope detection means comprises a rectifier and a 
lowpass filter. 

59. A system according to claim 57 or 58, wherein the lower 
cutoff frequency of the bandpass or highpass filter is at 

20 least 2 kHz, such as about 3 kHz. 

60. A system according to any of the claims 57-59, wherein 
the upper cutoff frequency of the bandpass filter is in the 
range between 4.5 and 7 kHz, preferably about 6 kHz. 

61. A system according to any of the claims 58-60, wherein 
25 ^ the rectifier is a one-way rectifier. 

62. A system according to any of claims 58-61, wherein the 
cutoff frequency of the lowpass filter is in the range of 
400-1000 Hz, preferably about 700 Hz. 
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63. A system according to claim 55 or 56, wherein the 

envelope detection means comprises a filter bank. 
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